Time-Scale and Noise Optimality in Self-Organized Critical Adaptive Networks 
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Recent studies have shown that adaptive networks driven by simple local rules can organize into 
"critical" global steady states, providing another framework for self-organized criticality (SOC). We 
focus on the important convergence to criticality and show that noise and time-scale optimality 
are reached at finite values. This is in sharp contrast to the previously believed optimal zero 
noise and infinite time scale separation case. Furthermore, we discover a noise induced phase 
transition for the breakdown of SOC. We also investigate each of the three new effects separately 
by developing models. These models reveal three generically low-dimensional dynamical behaviors: 
time-scale resonance (TR), a new simplified version of stochastic resonance - which we call steady 
state stochastic resonance (SSR) - as well as noise-induced phase transitions. 

PACS numbers: 05.65.-|-b, 05.40.-a, 87.10.Ed, 87.16.Yc, 89.75.Fb 



The concept of self-organized criticality (SOC) was 
first proposed by Bak, Tang and Wiesenfeld 1] using the 
abelian sandpile model. The idea is that a dynamical 
system organizes without external influence to a special 
state near a continuous phase transition ^ i.e. to a state 



of marginal stability 
formation processing 
does not seem to exist 



which could provide optimal in- 
A precise definition of SOC 
but all models for SOC exhibit 
dynamics on different time-scales 01 ■ Recent studies have 
shown that SOC can be observed in adaptive networks 
(see e.g. [H-Q) where dynamical rules influence the net- 
work topology and vice versa. The focus for SOC in the 
adaptive networks has been to analyze the critical point 
and applications to neuroscience [1, 0] . Here we take a 
different viewpoint and focus on the convergence towards 
SOC, which is very important as a return from nearby 
states to SOC is required to actually use the criticality of 
the state. We are interested in optimality of the passage 
to SOC which is particularly interestin g th e context of 
forming optimal networks in the brain |10|. As a case 
study we consider an SOC network proposed by Born- 
holdt and Rohlf (BR) 3- We expect the phenomena in 
this model to apply to a wide variety of adaptive net- 
work SOC models; however, this claim still needs to be 
justified with future work. Effects found in full network 
simulations are going to be studied by developing simple 
models. This approach of isolating generic effects via sim- 
ple low-dimensional mathematical models has a long his- 
tory and has been particularly successful in the context 
of dynamical systems [11]. For SOC adaptive networks 
this approach has not yet been utilized as much as we be- 
lieve is necessary. A mathematically rigorous derivation 
for SOC adaptive networks in a mean-field limit does not 
seem to exist yet; hence we must take the approach via 
numerics and modelling. We define a slightly modified 
version of the adaptive network in [5J. Consider a di- 
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FIG. 1: Simulation of the BR model with initial conditions 
Kini ~ 1 (dashed curve) and Kini — 4 (solid curve) for 
{N,e,S,fj.,a) = (1000, 10-^10-^10~^0). (a) Time series 
of the average connectivity K. (b) Moving average of the 
curves from (a) in {K, C)-space. The dotted curve indicates 
the phase transition obtained in [Sj] (for N = 1024). 



reeled network with nodes {vi{t)}^^ E {il} ^^^d edges 
{eij{t)}f^j^i e { — 1,0,-1-1} without loops. The initial 
network G{t — 0) —: G(0) at t = is chosen as a random 
graph with random node values. Consider the connection 
matrix E{t) = {eij{t)}i'j=i and define 

f{t) = E{t)v{t)+ fw{t) + ar, (1) 

where ^ A/'(0, 1) represents noise with a > and /i G 
[0, 1] controls the influence of the current state of the 
node on its new state. The case a = = fj, corresponds 
to Then the node dynamics is given, via parallel 
update, by 



V^{t+l) 



sgn[/.(t)] 

V^{t) 



if/«(t)^0, 
if/,(t) = 0. 



(2) 



Possible applications for this setup are neural networks 



opinion formation [13| and collective behaviour [14 1 
where the rule ([2]) corresponds to nearest-neighbours in- 
formation transmission. 

After Ty node dynamics steps the average activ- 
ity of each node over the last Ta :— [Ty/2\ updates is 
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measured 



(3) 



Nodes with \Ai\ — 1 indicate frozen states, unchanged 
for a long time, while < 1 are active nodes. Denote 
the fraction of frozen nodes by C. Choose a site i at 
random and calculate Ai using ([3]). Let < (5 < 1 be 
a parameter; if > 1 — (5 then i receives a new edge 
Bij, with randomly chosen edge weight in {±1}, from a 
node j chosen at random. If \A{i)\ < 1 — 5 then one of 
the existing nonzero edges is deleted. In the context of 
neural networks frozen states are activated via new con- 
nections while active nodes can be reduced in activity; 
see [l^ for an interpretation in terms of synaptic plastic- 
ity. After the topological update the dynamics switches 
again to T„ node dynamics steps ([2|. It is natural [15 1 
to assume a time scale separation between the topolog- 
ical (slow) and the node (fast) dynamics which requires 
r„ > 1; we define < e := l/r„ < 1. For exam- 
ple, individual neuron dynamics is faster than synaptic 
plasticity. Bornholdt and Rohlf observed that random 
graphs with different initial connectivity Kini converge 
to a network with the same connectivity Kc{N) (see Fig- 
ure [T](a)) where Kc{N) — )> 2 as iV — oo. For fixed con- 
nectivity K and fixed number of nodes N , they averaged 
over different static topologies revealing a phase transi- 
tion of C{K, N) from C w to C w 1 near Kc upon 
decreasing K] see Figure [TJb). Hence the adaptive net- 
work self-organizes into a critical state {K^ Cc) using the 
combination of topological and node dynamics. 

We are interested in the dependence of SOC on the 
time scale separation and noise where the key object 
of study are finite-time trajectories of moving-average 
macroscopic variables {K{t),C{t)) for t e [0,T]. As- 
sume that Kini for G(0) is given with Ki^i 76 so 
that the network has to self-organize. First, we inves- 
tigate the effect of < e < 1 for T = 60000. Define 
{Kt,Ct) ■■= ((ii'(t))[T/2,T], (C(t))[T/2,T]) where (•)[t/2,t] 
denotes the time average for t G [T/2, T] i.e. we view the 
trajectory in [T/2, T] as being near its target state. Note 
that Kt, Ct are random variables depending on the ini- 
tial sample G(0). Figure [2] shows Kt for an average over 
100 samples of G(0); averaging over G(0) is indicated by 
calligraphic letters e.g. {Kt)g = ^t- Define the errors 
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forXe{K,C}. (4) 



Figure [2](a)-(b) displays a global minimum lCT{tmin) 
upon time scale variation; this is an effect caused by 
the high connectivity initial condition Kini = 4 and the 
curve is expected to be monotone increasing for Kini- 
There is always a unique finite e optimal for the crite- 
rion mine I^T(e) — Kc\ of trajectories being close to the 
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FIG. 2: Full network simulation (dots), averaged over 
100 samples G{Q) with one standard deviation bars for 
(iV, r, K,„,, 5, a) = (1000, 6 • 10*, 4, 10-^ 10-^ 0). (a) Tar- 
get connectivity ICt ~ K.t[^)\ interpolation of the data is 
shown, (b) Zoom near the global minimum from (a), (c) 
Frozen component error Ec ~ Ec{(-)- 



critical connectivity. The error Ec{e) in Figure [H^c) also 
seems to depend non-monotonously on e and is always 
expected to yield a unique finite e optimality if we start 
away from the critical point. These observations lead 
to the main conclusion that SOC systems have optimal 
operational time scales. 

As stated in the introduction, after identifying an ef- 
fect, we aim to develop a simple abstract representation 
of the dynamical phenomenon. As a model problem con- 
sider the fast-slow system 



X 



dx 

dt ~ 

^ = V 

dt y 



(5) 



For illustration purposes, we introduce one of the sim- 
plest systems with time scale optimality given by 



f{x,y)^{v-\f -X, g(x,v) = \-y. 



(6) 
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FIG. 3; Illustration of time scale optimality for model prob- 
lem (Is])-®, (a) \xt\ and error E^(e) for trajectories start- 
ing at (a::(0), 1/(0)) = (—3,3) (square) with integration time 
t £ [0,2] = [0, r]. (b) Geometry in phase space. Critical 
manifolds as e ^ (dashed grey), e — >■ oo (solid grey) with as- 
sociated singular trajectories (black dashed/solid) are shown. 
The dotted curve is numerical integration for e = 1. 

This system has a globally asymptotically stable 
steady state (0,1) —: {xcUc) which we think of as the 
SOC state. Figure[3fal) shows \xt\, calculated for T = 2 
as before, which exhibits optimal criticality near e w 1 
when XT ~ Xc- Figure [3]Ja2) shows the error E^^e) = E^ 



displaying a clear global minimum. Time scale optimal- 
ity is a phenomenon that has not been considered so far 
in the geometric fast-slow systems theory [l^. However, 
there is an easy geometric explanation illustrated in Fig- 
ure [3{b). If e then x is fast and y is slow. The 
critical manifold Sf = {f ^ 0} is normally hyperbolic 
attracting with respect to x as D^flsf = — 1 < 0. Slow 
flow trajectories on Sf converge to {xc, tjc)- If e oo, the 
situation is reversed with x slow and y fast. The critical 
manifold Sg = {g ^ 0} is normally hyperbolic attracting 
as Dyg\sg = — 1 < 0. After a fast initial segment trajec- 
tories on Sg converge to {xc,yc)- Figure |3ljb) also shows 
a numerically integrated trajectory for e = 1. Fenichel 
theory [13] implies that for < e < 1 or 1 < 1/e the 
geometric description persists and Sf^g perturb to invari- 
ant manifolds g. In a neighbourhood of Sj ^ dynamics 
is slow which explains the shape of the functions |a;T(e)| 
and Ex{e). 

Obviously different slow manifold geometries can pro- 
duce various optimality curves. Furthermore, the simple 
description of the time scale optimality phenomenon sug- 
gests that it may have a much wider relevance for multi- 
scale systems that occur frequently in various applica- 
tions. Therefore we suggest a new name for the effect: 
time- scale resonance (TR). 
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FIG. 4: Full network simulation (dots), averaged over 
100 samples G{Q) with one standard deviation bars for 
{N,T,Kini,S,fi,£) = (1000, 10^ 4, 0.5, 0.5,0). (a) Connectiv- 
ity error Ek = Ek(o-). (b) Phase transition in ICt{o') upon 
noise variation. 

It was observed in Q that the adaptive SOC network is 
"robust" against small noise. Here we take this idea one 
step further and consider a much broader range of noise 
strengths. Figure IH^a) shows the error Ek{(t) where we 
first focus on cr < 0.25. In the range a S [0,0.25] we 
observe a noise-optimal minimum near a « 0.2. This 
suggests the possibility of optimal noise for SOC. It is 
well-known that noise can play a constructive role via ef- 
fects such as stochastic resonance (SR) [11 [li which has 
various applications (20| . In SR noise-optimality is usu- 
ally defined for coherence statistics along periodic orbits 
2l| which is different from the SOC situation where con- 
vergence to a critical state is observed. We shall explain 
with two models easy possibilities of noise-optimality for 



convergence to a steady state. First, consider ([5]) with 
f{x,y) = yx - x^ + a£,{t), g{x,y) ^ {x* ~ \x\) (7) 
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FIG. 5; Numerical integration for ^ with {e,x*,T) = 
(0.01,0.05,2000) and initial condition {x{0),y{0)) = 
(0.1, —0.1). (a) Error for "self-organization" depending on 
the noise intensity, (b) Geometry in phase space: The crit- 
ical manifold {/ = 0} (grey) and two trajectories for a = 
(dashed, black) and a = 10~^ (solid, black) are shown start- 
ing at (x(0),y(0)) (black square). 

where {^{t)^{t')) — 6{t — t') is white noise and < 
d,x* <^ I are parameters. The SDE defined by ([7]) is 
invariant under the map a; ^ —a; so we consider it only 
on the quotient space (x, y) G E^/(a: —x) = R,^ x R. 
Observe that yx — x^ is the normal form vector field for 
a pitchfork bifurcation with parameter y. In contrast to 
the classical delayed pitchfork bifurcation, there exists a 
steady state {xc,yc) = {x*,{x*)^) which represents the 
SOC state lying near the bifurcation point. Figure ^a.) 
shows Ex (ct) computed from numerical integration which 
has a global minimum at finite noise. The geometric un- 
derstanding is based on shortening of bifurcation delay 
due to noise [2§| which is well understood; see Figure 
[S{b). In our case, the additional steady state [xc, yc) near 
the bifurcation is the novel feature that shows how short- 
ening of bifurcation delay can lead to noise-optimality. 
It is very important to note that the mechanism is local 
since we could let x* 0+ and observe noise optimal- 
ity for trajectories in an arbitrarily small neighbourhood 
of (x, y) = (0,0). We refer to the general concept of 
noise-optimality for convergence as steady-state stochas- 
tic resonance (SSR). 

There are many other possible geometries to obtain 
SSR. As a second example, consider the excitable systems 
case [23[ with the vector fields in ([5]) given by 



f( \ 2 x^ 

f(x,y) = ~ Y 



g{x,y) =x-y + l + a^{t) 



with initial conditions {x{0),y{0)) — (—2,-1 — w) for 
some small lj > 0. Then it is easy to deduce from 
the global geometry that SSR occurs as small noise in 
the slow variable can avoid the large excursion/spike to- 
wards a: > and make sample paths converge directly to 
the globally asymptotically stable equilibrium of the de- 
terministic system. For the same initial conditions and 
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CT = 0, we can also get TR which yields an interesting 
two-parameter interplay which will be considered in fu- 
ture work. 

We return to the full network simulation for SOC 
shown in Figure 31 In Figure IH^b) a noise-induced phase 
transition can be observed between a final SOC state 
with networks Kt ~ 3 for low noise and Kt ~ for high 
noise with a sharp transition near a w 0.25. The effect 
of noise-induced phase transitions - and in particular the 
failure to reach the classical SOC state (here Kc = 2) - 
has not been previously observed in SOC adaptive net- 
works. The basic explanation is that higher noise values 
make the sequence of observed states Vi{t) for t € [Ta, T^] 
more random. This implies that a node i is viewed as 
"active" and \Ai\ < 1 — S is more likely to hold which 
results in edge deletion. Therefore SOC is not robust 
against arbitrary noise cr > 0. It persists up to a critical 
value (7 ^ ffc which is the expected behaviour e.g. for 
any biological systems displaying SOC 



12| 



To model the noise-induced phase transition, consider 
the connectivity K{t) as evolving in an energy landscape 
in continuous time 

dK 
~dt 



— = -\7V{K;d) +a^{t), K>0. 



(8) 



The vector field ([5]) can be thought of as representing the 
rates of change in the infinite network limit iV — > oo. The 
adaptivity of the network suggests that local noise may 
also change the global potential V which we choose as 



V{K-d) := 



-(3 



3 

as shown in Figure [Hl[b). For a — Q the ODE ([5]) has a 
stable steady state at K^. = 3 for iiT > 0; we choose the 
initial condition always as K{Q) = 3. It is important to 
note that the system (|S]) without the white noise term will 
always stay at the stable steady state Kc for e [0,3). 




FIG. 6: Numerical integration for (O with T = 2000 and 
initial condition K{Q) = 3. (a) Error for "self-organization" 
depending on d. (bl)-(b4) Potentials V — V{K) for different 
a€ {0,1,1.5,2}. 

In Figure |6fa) a noise- induced phase transition for Kt 
is observed for a ~ 1.5. Obviously there are many other 
models - discrete and/or continuous time - that may pro- 
duce a similar effect. Here we have just provided one of 
the simplest model examples. 



In summary, we have found interesting time scale and 
noise optimality in convergence to SOC as well as a noise- 
induced phase transitions for full network simulation of 
the BR model. We described each of the three effects 
by simple abstract models hinting at interesting generic 
phenomena such as time scale resonance (TR), steady 
state stochastic resonance (SSR) as well as the possibil- 
ity of noise-induced phase transitions in varying poten- 
tials. If our results turn out to hold for adaptive SOC 
models in applications we can draw several conclusions: 
(a) for processes near criticality one must determine the 
finite optimal time scales of these processes relative to 
each other, (b) information processing in complex sys- 
tems near steady-state criticality can exhibit noise op- 
timality providing another fundamental mechanism be- 
sides SR and (c) evolution may potentially drive a sys- 
tem towards finite optimal noise and time scale values. 
The last conclusion is a potential hint why it is currently 
problematic to match neural network models to exper- 
iment as the singular limt (e, a) — ?• (0, 0) is often the 
analytical starting point. 
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